Sharp Inequalities for Optimal Stopping with Rewards Based on Ranks
نویسنده
چکیده
A universal bound for the maximal expected reward is obtained for stopping a sequence of independent random variables where the reward is a nonincreasing function of the rank of the variable selected. This bound is shown to be sharp in three classical cases: (i) when maximizing the probability of choosing one of the k best; (ii) when minimizing the expected rank; and (iii) for an exponential function of the rank.
منابع مشابه
An application of prophet regions to optimal stopping with a random number of observations
Let X1,X2, . . . be any sequence of nonnegative integrable random variables, and let N ∈ {1, 2, . . . } be a random variable with known distribution, independent of X1,X2, . . . . The optimal stopping value supt E(XtI(N ≥ t)) is considered for two players: one who has advance knowledge of the value of N , and another who does not. Sharp ratio and difference inequalities relating the two players...
متن کاملOn Explore-Then-Commit strategies
We study the problem of minimising regret in two-armed bandit problems with Gaussian rewards. Our objective is to use this simple setting to illustrate that strategies based on an exploration phase (up to a stopping time) followed by exploitation are necessarily suboptimal. The results hold regardless of whether or not the difference in means between the two arms is known. Besides the main mess...
متن کاملOptimal Stopping for Non-linear Expectations
We develop a theory for solving continuous time optimal stopping problems for non-linear expectations. Our motivation is to consider problems in which the stopper uses risk measures to evaluate future rewards.
متن کاملOptimal Stopping for Dynamic Convex Risk Measures
We use martingale and stochastic analysis techniques to study a continuous-time optimal stopping problem in which the decision maker uses a dynamic convex risk measure to evaluate future rewards.
متن کاملOptimal stopping for non-linear expectations—Part I
We develop a theory for solving continuous time optimal stopping problems for non-linear expectations. Our motivation is to consider problems in which the stopper uses risk measures to evaluate future rewards. Our development is presented in two parts. In the first part, we will develop the stochastic analysis tools that will be essential in solving the optimal stopping problems, which will be ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006